Model Integration in Computational Biology: The Role of Reproducibility, Credibility and Utility

During the COVID-19 pandemic, mathematical modeling of disease transmission has become a cornerstone of key state decisions. To advance the state-of-the-art host viral modeling to handle future pandemics, many scientists working on related issues assembled to discuss the topics. These discussions exposed the reproducibility crisis that leads to inability to reuse and integrate models. This document summarizes these discussions, presents difficulties, and mentions existing efforts towards future solutions that will allow future model utility and integration. We argue that without addressing these challenges, scientists will have diminished ability to build, disseminate, and implement high-impact multi-scale modeling that is needed to understand the health crises we face.

Transcriptogram analysis reveals relationship between viral titer and gene sets responses during Corona-virus infection.

To understand the difference between benign and severe outcomes after Coronavirus infection, we urgently need ways to clarify and quantify the time course of tissue and immune responses. Here we re-analyze 72-hour time-series microarrays generated in 2013 by Sims and collaborators for SARS-CoV-1 in vitro infection of a human lung epithelial cell line. Transcriptograms, a Bioinformatics tool to analyze genome-wide gene expression data, allow us to define an appropriate context-dependent threshold for mechanistic relevance of gene differential expression. Without knowing in advance which genes are relevant, classical analyses detect every gene with statistically-significant differential expression, leaving us with too many genes and hypotheses to be useful. Using a Transcriptogram-based top-down approach, we identified three major, differentially-expressed gene sets comprising 219 mainly immune-response-related genes. We identified timescales for alterations in mitochondrial activity, signaling and transcription regulation of the innate and adaptive immune systems and their relationship to viral titer. The methods can be applied to RNA data sets for SARS-CoV-2 to investigate the origin of differential responses in different tissue types, or due to immune or preexisting conditions or to compare cell culture, organoid culture, animal models and human-derived samples.

Multiscale Model of Antiviral Timing, Potency, and Heterogeneity Effects on an Epithelial Tissue Patch Infected by SARS-CoV-2.

We extend our established agent-based multiscale computational model of infection of lung tissue by SARS-CoV-2 to include pharmacokinetic and pharmacodynamic models of remdesivir. We model remdesivir treatment for COVID-19; however, our methods are general to other viral infections and antiviral therapies. We investigate the effects of drug potency, drug dosing frequency, treatment initiation delay, antiviral half-life, and variability in cellular uptake and metabolism of remdesivir and its active metabolite on treatment outcomes in a simulated patch of infected epithelial tissue. Non-spatial deterministic population models which treat all cells of a given class as identical can clarify how treatment dosage and timing influence treatment efficacy. However, they do not reveal how cell-to-cell variability affects treatment outcomes. Our simulations suggest that for a given treatment regime, including cell-to-cell variation in drug uptake, permeability and metabolism increase the likelihood of uncontrolled infection as the cells with the lowest internal levels of antiviral act as super-spreaders within the tissue. The model predicts substantial variability in infection outcomes between similar tissue patches for different treatment options. In models with cellular metabolic variability, antiviral doses have to be increased significantly (>50% depending on simulation parameters) to achieve the same treatment results as with the homogeneous cellular metabolism.

Multicellular spatial model of RNA virus replication and interferon responses reveals factors controlling plaque growth dynamics.

Respiratory viruses present major public health challenges, as evidenced by the 1918 Spanish Flu, the 1957 H2N2, 1968 H3N2, and 2009 H1N1 influenza pandemics, and the ongoing severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic. Severe RNA virus respiratory infections often correlate with high viral load and excessive inflammation. Understanding the dynamics of the innate immune response and its manifestations at the cell and tissue levels is vital to understanding the mechanisms of immunopathology and to developing strain-independent treatments. Here, we present a novel spatialized multicellular computational model of RNA virus infection and the type-I interferon-mediated antiviral response that it induces within lung epithelial cells. The model is built using the CompuCell3D multicellular simulation environment and is parameterized using data from influenza virus-infected cell cultures. Consistent with experimental observations, it exhibits either linear radial growth of viral plaques or arrested plaque growth depending on the local concentration of type I interferons. The model suggests that modifying the activity of signaling molecules in the JAK/STAT pathway or altering the ratio of the diffusion lengths of interferon and virus in the cell culture could lead to plaque growth arrest. The dependence of plaque growth arrest on diffusion lengths highlights the importance of developing validated spatial models of cytokine signaling and the need for in vitro measurement of these diffusion coefficients. Sensitivity analyses under conditions leading to continuous or arrested plaque growth found that plaque growth is more sensitive to variations of most parameters and more likely to have identifiable model parameters when conditions lead to plaque arrest. This result suggests that cytokine assay measurements may be most informative under conditions leading to arrested plaque growth. The model is easy to extend to include SARS-CoV-2-specific mechanisms or to use as a component in models linking epithelial cell signaling to systemic immune models.

A multiscale multicellular spatiotemporal model of local influenza infection and immune response.

Respiratory viral infections pose a serious public health concern, from mild seasonal influenza to pandemics like those of SARS-CoV-2. Spatiotemporal dynamics of viral infection impact nearly all aspects of the progression of a viral infection, like the dependence of viral replication rates on the type of cell and pathogen, the strength of the immune response and localization of infection. Mathematical modeling is often used to describe respiratory viral infections and the immune response to them using ordinary differential equation (ODE) models. However, ODE models neglect spatially-resolved biophysical mechanisms like lesion shape and the details of viral transport, and so cannot model spatial effects of a viral infection and immune response. In this work, we develop a multiscale, multicellular spatiotemporal model of influenza infection and immune response by combining non-spatial ODE modeling and spatial, cell-based modeling. We employ cellularization, a recently developed method for generating spatial, cell-based, stochastic models from non-spatial ODE models, to generate much of our model from a calibrated ODE model that describes infection, death and recovery of susceptible cells and innate and adaptive responses during influenza infection, and develop models of cell migration and other mechanisms not explicitly described by the ODE model. We determine new model parameters to generate agreement between the spatial and original ODE models under certain conditions, where simulation replicas using our model serve as microconfigurations of the ODE model, and compare results between the models to investigate the nature of viral exposure and impact of heterogeneous infection on the time-evolution of the viral infection. We found that using spatially homogeneous initial exposure conditions consistently with those employed during calibration of the ODE model generates far less severe infection, and that local exposure to virus must be multiple orders of magnitude greater than a uniformly applied exposure to all available susceptible cells. This strongly suggests a prominent role of localization of exposure in influenza A infection. We propose that the particularities of the microenvironment to which a virus is introduced plays a dominant role in disease onset and progression, and that spatially resolved models like ours may be important to better understand and more reliably predict future health states based on susceptibility of potential lesion sites using spatially resolved patient data of the state of an infection. We can readily integrate the immune response components of our model into other modeling and simulation frameworks of viral infection dynamics that do detailed modeling of other mechanisms like viral internalization and intracellular viral replication dynamics, which are not explicitly represented in the ODE model. We can also combine our model with available experimental data and modeling of exposure scenarios and spatiotemporal aspects of mechanisms like mucociliary clearance that are only implicitly described by the ODE model, which would significantly improve the ability of our model to present spatially resolved predictions about the progression of influenza infection and immune response.

Advancing therapies for viral infections using mechanistic computational models of the dynamic interplay between the virus and host immune response.

The COVID-19 pandemic has highlighted a need for improved frameworks for drug discovery, repurposing, clinical trial design and therapy optimization and personalization. Mechanistic computational models can play an important role in developing these frameworks. We discuss how mechanistic models, which consider viral entry, replication in target cells, viral spread in the body, immune response, and the complex factors involved in tissue and organ damage and recovery, can clarify the mechanisms of humoral and cellular immune responses to the virus, viral distribution and replication in tissues, the origins of pathogenesis and patient-to-patient heterogeneity in responses. These models are already improving our understanding of the mechanisms of action of antivirals and immune modulators. We discuss how closer collaboration between the experimentalists, clinicians and modelers could result in more predictive models which may guide therapies for viral infections, improving survival and leading to faster and more complete recovery.

A modular framework for multiscale, multicellular, spatiotemporal modeling of acute primary viral infection and immune response in epithelial tissues and its application to drug therapy timing and effectiveness.

Simulations of tissue-specific effects of primary acute viral infections like COVID-19 are essential for understanding disease outcomes and optimizing therapies. Such simulations need to support continuous updating in response to rapid advances in understanding of infection mechanisms, and parallel development of components by multiple groups. We present an open-source platform for multiscale spatiotemporal simulation of an epithelial tissue, viral infection, cellular immune response and tissue damage, specifically designed to be modular and extensible to support continuous updating and parallel development. The base simulation of a simplified patch of epithelial tissue and immune response exhibits distinct patterns of infection dynamics from widespread infection, to recurrence, to clearance. Slower viral internalization and faster immune-cell recruitment slow infection and promote containment. Because antiviral drugs can have side effects and show reduced clinical effectiveness when given later during infection, we studied the effects on progression of treatment potency and time-of-first treatment after infection. In simulations, even a low potency therapy with a drug which reduces the replication rate of viral RNA greatly decreases the total tissue damage and virus burden when given near the beginning of infection. Many combinations of dosage and treatment time lead to stochastic outcomes, with some simulation replicas showing clearance or control (treatment success), while others show rapid infection of all epithelial cells (treatment failure). Thus, while a high potency therapy usually is less effective when given later, treatments at late times are occasionally effective. We illustrate how to extend the platform to model specific virus types (e.g., hepatitis C) and add additional cellular mechanisms (tissue recovery and variable cell susceptibility to infection), using our software modules and publicly-available software repository.